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Long  Term  Goals 


rnhcrsit> 


•  Investigate  performance  of 
self-synchronizing  teams 

•  Understand  how  teams  collaborate  on  a 
shared  surface  in  situations  characterized  by 
high  stakes,  uncertainty  and  time  pressure 
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STRUCTURAL  MODEL  OF  TEAM  COLLABORATION 

(MACRO-COGNITIVE  PROCESS  FOCUS) 


Characteristics 


Collaborative  Situation 


Parameters: 


•  time  pressure 
-  information/knowledge 


•  dynamic  information 

•  iarge  amount  of l^nowiedge 
(cognitive  overioad) 

•  human-agent  interface 
compiexity 

Team  Types 


•  asynchronous 

•  distributed 

•  cuituraiiy  diverse 

•  heterogeneous  knowiedge 

•  unique  roles 

•  command  structure 
(hierarchical  vs.  flat) 

•  rotating  team  members 
Operational  Tasks 


•  team  decision  making,  COA 
selection 

•  develop  shared  understanding!!^ 

•  intelligence  analysis 
(team  data  processing) 


Collaboration 

Complete 


TUPta-rnanitivP; 

n*  individual  conversion  oi^ 
^^^(;iata  to  knowledge 


Collaboration  Stages  &  Cognitive  Processes 


I  Macro-Cognitive; 

I  _ 


T--eOi 


individual  mental  mode! 
instruction 


ie^ 


•  knowledge  interoperability 
development 

•  individual  task,  team  and  domain 
knowledge  development 

•  individual  knowledge  object 
'  ijllTliripiiii  Ml 

individual  visualization  and^ 
^^^representation  of  meaning^^ 


•  team  integration  of  individual 
^^owledge  for  common  understand!] 


•  knowledge  interoperability 
development 

•  iterative  information  collection 

and  analysis 

•  team  shared  understanding 
development 

•  develop,  rationalize,  &  visualize 

^llliiiii  iilli  III  nil  I  I 

•  convergence  of  individual  mental 
models  to  team  mental  model 

^ ^ 

•  individual  iask,  and  domain 
knowledge  development 

•  developing  new  knowledge 

•  team  agreement  on  situation 


» convergence  of  individual 
mental  models 
»  critical  thinking 


I 


solution  adjustment  to 
fit  goals  and  exit  criteria 


compare  problem  solution 
against  goals 

team  shared  understanding 
development 

convergence  of  individual 
mental  models  of  solution 


LSharinp  hidden  knowledge  .  analyze,  revise  output 


•  individual  task  knowledge 
development  (continued) 

•  team  task  knowledge 
development  (continued) 


I 


'  Hayne,  Smith,  and  Vijayasarathy, 


Mechanisms  for  achieving  Meta,  Macro,  and  Micro-Cognitive  Processes  (applies  to  all  stages) 

•  Verbal  communications:  presenting  and  discussing  individual  information,  discussing  team  generated  information, 
questioning,  agreeing  /  disagreeing,  negotiating  perspectives,  discussing  possible  solutions,  providing  rationale. 

•  Non-Verbal  communications:  facial  expressions,  voice  clues  (vocal  paralanguage),  hand  gestures,  body  movements  (kinesics), 

touch  (haptics),  personal  space,  drawing,  text  messages,  augmented  video,  affordances  (cognition  in  objects).  o 

DM - 


Research  Model 


Collaboration 

Push/Pull 


Pattern  Sharing 


Situation 

Assessment 


Templates 


Response 

Selection 


Proposed 
Distribution 
Of  Forces 


Actual 
Distribution 
Of  Forces 


Team  Recognition  Primed  Decision  Making 
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Project  Objective 


•  Validate  Model: 

Team  Recognition  Primed  Decision-Making 

•  Empirical  investigation  for  validity  of: 

—  Pattern  Sharing  of  Cognitive  Chunks 
—  Negotiated  Interrupts  (Push/Pull) 
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Current  Research  Plan 


•  Extend  Model 

—Items  Sharing  vs.  Chunks  Sharing 
—Time  Pressure 
—CO A  selection  (bumping) 
—Incorporate  Template  Theory 
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Fernand  Gobet  and  Herb  Simon 


•  Experienced  people  create  complex 
structures  called  “templates” 

•  Templates  have  a  core  and  slots  and 
linkages  to  other  templates  which  facilitates 
fast  access  to  long  term  memory 

•  Templates  can  store  at  least  10  items  and 
are  often  labeled 
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Chess  Template 


a) 

Te  mplate-corc: 

>\'hite  ^^ic4.  (!id5,  Ae4>  af2,  g2,  i>gl, 

Ebck  ic7,  ld6,  ic5,  m,  lg6,  Ihl,  igS,  JtcS,  ftf6,Ag7 


Slot  for 

A 

:  hZ,  h3 

i 

:  a7,  a5 

e 

« 

:  bS,  (37*  c,') 

I 

:  fS*  e8 

7 

:  c2,  dl 

[  cl  j  dZ.  c3 

Shit  fur 

squares: 

d2: 

Jl*  empty 

eS  : 
el  : 

Z »  4i»  cmp[y 

Z.  Si* empty 

4 

,  1 

Slot  for 

opening; 

Kingb  Indian  Defense 

Slot  for  plans: 

Break  in  the  center  with  17 -f5 

f  P 

Slot  for 

moves; 

1.,.  NfS'CS 

a 

K.,  Nm-h5 

IJnks  to  other  ternpl.ute!&:  chunk  #231 


^  viig  i  ^  i 


<  e 
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FY  V3  Research  Plan 


•  Explore  sharing  of  pattern  chunks 

—  Labels 

—  Templates  (core  and  slots) 

•  Rewards  for  speed  and  accuracy 

•  Explore  implication  of  bumping 
on  slot  information 
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Hypotheses 


rnhcrsit> 


•  Teams  using  a  compensatory  aid  for  pattern- 
recognition  tasks  will  outperform  teams  who  do 
not. 

•  Teams  sharing  chunk/template  labels  for 
pattern-recognition  tasks  will  outperform 
teams  who  share  individual  items. 

•  Teams  using  negotiated  interrupts  with  each  other 
for  pattern-recognition  tasks  will  outperform 
teams  who  do  not. 
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FY  V3  Progress 


rnhcrsit> 


•  Data  Collected  and  Analysis  Performed: 

—  Chunking  (39  subjects) 

—  Chunking  Time  Pressure  (36  subjects) 

—  No  Sharing  Time  Pressure  (36  subjects) 

—  No  Sharing/Bumping  Time  Pressure  (45  subjects) 

—  Continuous  performance  task  “pilot”  (2 1  subjects) 

•  International  Journal  of  Human  Computer  Studies 

—  first  article  from  last  year’s  results  accepted. 

•  ICIS  Cognitive  Workshop,  DSS2004  Conference 

•  OBHDP  (submitted) 

•  ACM  Transactions  on  CHI  (close  draft) 
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Decision  Game 


•  Cooperative  3 -Player  Game 

•  Each  player  has  7  Tokens  (numbered  1-7) 

•  Opponent  has  asymmetric  force 

—  Patterns:  Definitive,  Equivocal,  Uncertain 

•  Team  places  tokens  so  total  >=  opponent 

•  Incentive 

—  For  total  points 
—  For  time  of  play 

•  Play  is  interactive 
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Patterns 


Chunk  Labels 
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Our  Patterns  as  Templates 


Tnhcrsit> 
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Need  video!!! 


Pattern  Chunks 
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unking  Treatments  -  Performance 
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aring  Correctness  and  Performance 


(/) 

4-1 

C 

o 

Q. 


7.50 

7.25 
7.00 

6.75 

6.50 

6.25 
6.00 

5.75 

5.50 

5.25 
5.00 

4.75 

4.50 

4.25 
4.00 


Game  Point  Means 

■  All  Sharing  Incorrect 

B  An  Sharing  Correct 

-I- 

Definitive  Equivocal 

Pattern  Type 
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Player  Type  and  Sharing 


Sharing  Means 
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Player  Type  and  Correct  Sharing 


Sharing  Means 


Correlation  between  Sharing  Correctness  and  Good  Moves  =  0.25  (p  <  0.05) 
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Move  Time  (Seconds) 
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Time  pressure  when  moving. . . 
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Bumping  and  Performance 


(/) 

c 

o 

Q. 


7.00 


6.00 


5.00 


4.00 


3.00 


Game  Point  Means 


■  No  Bumping 

■  Bumping 


Definitive 


Uncertain 


Equivocal 


Pattern  Type 
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Player  Type  and  Number  of  Bumps 
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layer  Type  and  Number  of  Good  Bumps 
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Core  vs.  Slot 


©  Hayne,  Smith,  and  Vijayasarathy,  2004 


24 


Conclusions 


•  Team  Recognition  Primed  Decision  Making 
Model  Continues  to  be  Validated 

•  Sharing  of  Pattern  Chunks  Improves 
Performance 

—  Cognitive  Alignment 
— Ultra  Thin  tool 

•  Support  for  Gobet/Simon  Template  Model. . . 

—knowledge  exehange  (bump)  on  slot  data! ! ! 
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Research  Model 


Team  Recognition  Primed  Decision  Making 
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OokM^ 

l  ’ni^  crsit> 

Transitions  to  Navy  Tasks 

•  Principles 

-  Provide  Pattern- Sharing  Tool  for  SA  Task 

-  Provide  Stimulating  Structure  Tool  for  Action 
Task 

-  Transform  Effortful  Cognitive  Tasks  into 
Simple  Perceptual  Tasks 
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FY  2004 


Plans  and  Onward 


•  Change  task  domain  (increase  complexity) 

•  Operational  Task  (continuous  performance) 

—  Continue  to  core/slot  concept 

—Manipulate  the  ability  of  team  members  to  “push” 
or  “pull”  pattern  information  from  their 
teammates  (negotiated  interrupts) 

—Manipulate  team  roles  (peer,  hierarchical,  etc.) 
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NEO  -  when  the  plan  breaks . . . 


•  Personnel  Selection  completed 

•  Training  completed 

•  Planning  completed 

•  Operation  underway 

—  Contingency  theory  about  sharing  core/slot  data 
— Prescriptions  for  user  interfaces 
—Empirical  testing  with  the  “hairy  water  buffalo” 
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Operational  Task  Research  Design 


l’nhcrsit> 


•  Team  Warship  Commander  Task 

-  3  person  teams 

-  Zones  of  influenee 

•  Comparison: 

-  Message-based  tool  vs.  Perceptual  Push  Tool 

•  Common  briefing  for  Core  Data  items 

-  E.g.,  red  symbols  are  hostile,  blue  are  friendly 

•  Private  briefing  for  Slot  Data  items 

-  E.g.,  anything  with  a  dot  in  the  middle  is  hostile 
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Research  Design  (cont.) 


•  Within  Subjects,  treatment  counterbalanced 

•  Rewards  for  performance 

•  Independent  Variables 

-  Count  of  Type  1  and  Type  2  errors 

-  Count  of  Core  Data  shared 

-  Count  of  Slot  Data  shared 
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Team  Warship  Commander 
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Team  Warship  Commander 


Screen  Video 


Team  Member  Video 
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perational  Task  Research  Hypotheses 


•  HI:  A  Pattern- Sharing  Tool  is  useful  in 
Situation  Assessment  Phase  to  achieve 
consensus  about  Core  Data 

•  H2:  A  Stimulating  Structure  is  useful  in 
Action  Phase  to  reveal  local  expertise  about 
Slot  Data 

•  H3:  Stasser’s  findings  re  sharing  of  common 
vs.  private  data  reflect  Core  vs.  Slot  Data 
during  Situation  Assessment  Phase 
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Pilot  Study  Results 


•  Teams  unable  to  attend  to  both  tasks 

•  Some  teams  attempt  to  share  slot  data 

•  Teams  unable  to  hold  knowledge  in  short 
term  memory 

-  Large  numbers  of  “type  2”  errors 
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Chat  Transcripts 


00:00:12  1-  yellow  w  hat  inside  bad 
00:00:46  2-  honeycomb  with  plus  bad 
00:01:27  3-  what  colors?? 

00:01:43  1-  square  w  plus  bad 

00:01:51  3-  colors 

00:02:01  1-  orange  square  w  plus 

00:02:41  2-  yellow  honeycomb  with  plus  bad 

00:02:50  2-  purple  rectangle  with  dot  bad 

00:03:00  2-  purple  triangle  bad 

00:03:16  3-  square  or  rectangle  with  plus  bad? 

00:03:40  1-  hat  inside  yello  dome  bad 

00:04:43  3-  diamond  with  hat  inside  green  bad 

00:04:59  3-  clover  with  dot  inside  green  bad 

00:05:45  3-  clover  with  hat  inside  purple  bad 

00:06:3 1  3-  on  purple  triangle  bad  what  is  inside  it 

and  do  you  mean  diamond? 

00:07:04  2-  purple  diamond  with  anvil  inside 
00:08:47  1-  yellow  hat  in  yello  dome  bad 
00: 10: 113-  refresh  on  orange  bad? 

00:10:14  3-  details  again 

00:10:19  3-  color  and  shape  and  whats  unside 

00:10:27  1-  orange  dimaond  w  plus  bad 


00:00:39  3-  purple  rounded-clover  shape  with  squarish  black 
center  is  hostile 
00:01:40  2- 

00:01:45  3-  green  4-point  diamond  is  hostile 
00:02:33  3-  green  rounded-comer  cloverleaf  with  dot  is 
hostile 

00:04:49  3-  can  anyone  see  what  i'm  typing??? 

00:05:06  1-  ywa 
00:05:07  1-yes 
00:05:16  1-  too  busy 

00:06:17  1-  watch  to  see  who  bnlows  up  who  in  yellow 

00:07: 1 8  2-  purple  rectangle  w  black  dot  is  bad 

00:10:29  2-  yellow  clover  w  cross  is  bad 

00: 10:3 11-  diamond  yellow  with  plus  =  hostile 

00:10:48  3-  good  good  info  is  good 

00: 1 1 :02  3-  it's  easier  for  me  to  watch  my  own  sector  with 

more  info 

00: 1 1 :07  1-  all  you  need  to  do  is  see  who  blows  up  who  in 
yellow! ! 
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Questions? 
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